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Description 

BACKGROUND OF THE INVENTION 

1. Technical Field s 

[0001] The present invention relates generally to a 
communications system and in particular to a method 
and system for routing data traffic within the communi- 
cations system. Still more particularly, the present in- to 
vention relates to a system employed for routing real- 
time data traffic in an Internet Protocol (IP) communica- 
tions network. 

2. Description of the Related Art is 

[0002] The development of computerized information 
resources such as the "Internet" and the proliferation of 
"Web" browsers, allow users of data-processing sys- 
tems to link with other servers and networks, and thus 20 
retrieve vast amounts of electronic information hereto- 
fore unavailable in an electronic medium. Such electron- 
ic information is increasingly displacing more conven- 
tional means of information transmission such as news- 
papers, magazines, and even television. In electronic 25 
communications, a set of computer networks which are 
possibly dissimilar from one another are joined together 
by "gateways" that handle data transfer and the conver- 
sion of messages from the sending network to the pro- 
tocols utilized by the receiving network, with packets if 30 
necessary. A gateway is a device utilized to connect dis- 
similar networks (i.e., networks utilizing different com- 
munication protocols) so that electronic information can 
be passed from one network to the other. Gateways 
transfer electronic information converting such informa- 35 
tion to a form compatible with the protocols utilized by 
the second network for transport and delivery. The term 
"Internet" is an abbreviation for ■ internetwork, • and re- 
fers commonly to the collection of networks and gate- 
ways that utilize the TCP/IP suite of protocols, which are 
well-known in the art of computer networking. TCP/IP is 
an acronym for "Transport Control Protocol/Internet 
Protocol/ a software protocol developed by the U.S. 
Department of Defense for communication between 
computers. 

[0003] The evolution of personal computers over the 
last decade has accelerated the "Web" and "Internet" 
toward useful everyday applications. Nearly every com- 
puter sold over the last several years has or will, at some 
point, become "online" to an Internet service provider, so 
Somewhere between 20 and 30 million people around 
the globe utilize some form of Internet service on a reg- 
ular basis. The graphical portion of the World Wide Web 
itself is usually stocked with more than twenty-two mil- 
lion "pages" of content," with over one million new pages ss 
added every month. 

[0004] Free or relatively inexpensive computer soft- 
ware applications such as Internet "search engines" 



40 



45 



make it simple to track down Internet sites where an in- 
dividual can obtain a topic of interest. The market for 
Internet access and related applications is explosive 
and is growing faster than expected, doubling in size ap- 
proximately every three months. 

[0005] Advancements in communications arise from 
changing user needs and demands. Previously, public 
network needs were driven by telephoning, voice data. 
Data traffic has grown slowly until recently. With the low- 
er cost in telecommunications and the higher increase 
in processing power of computers, the numbers of users 
accessing communications networks has increased. 
The needs of these users include, for example, video 
telephone, low cost video conferencing, imaging, High 
Definition Television (HDTV), and other applications re- 
quiring multimedia data transfers. Multimedia combines 
different forms of media in the communication of infor- 
mation between a user and a data processing system 
such as a personal computer or network computer. A 
multimedia application is an application that uses differ- 
ent forms of communications within a single application. 
Multimedia applications may, for example, communi- 
cate data to a user on a computer via audio, text, and 
video simultaneously. Such multimedia applications are 
usually bit intensive, real time, and very demanding on 
communications networks. 

[0006] Internet Protocol (IP) networks are technology 
driving the Internet. The rise of these networks is prima- 
rily due to their acceptance as the layer 3 protocol in the 
enterprise networks. Most personal computers (PCs) 
now use transmission control protocol/IP (TCP/IP) as 
their networking protocol. IP has even gained accept- 
ance as the wide area protocol since it is about 25-30% 
more efficient than Asynchronous Transfer Mode 
(ATM). 

[0007] The kinds of traffic running over IP networks is 
of two major types. First, elastic traffic or non-real-traffic 
which is primarily data file transfer. Most of this traffic 
utilizes TCP as its transport level protocol and it can 
withstand delay quite well, but any corruption of data 
must be re-transmitted. Second, the inelastic or real- 
time traffic is interactive voice, video or data -conferenc- 
ing. This kind of traffic does not withstand delay well 
since late information in an interactive session is of no 
use. This kind of traffic uses Real Time Protocol (RTP) 
as the transport protocol. 

[0008] Running real-time traffic over IP networks has 
other significant problems also. Currently, there is no 
way of reserving bandwidth end-to-end in an IP network. 
Each IP packet takes its own route through the network. 
Therefore, each packet gets to its destination (in theory) 
through a different route and can have a different delay 
in getting to its destination. This causes delay variance 
or jitter at the destination where the packets have to be 
"played" for the destination user. Since most IP net- 
works rely on routers to switch traffic and these routers 
are quite often based on software switching, they can 
introduce excessive delay for real-time services. Fur- 
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SUMMARY OF THE INVENTION 

[001 8] It is one object of the present invention to pro- 
vide an improved method and system for a communica- 
tions system. 

[0019] It is another object of the present invention to 
provide an improved system and method for routing da- 
ta traffic within the communications system. 
[0020] It is yet another object of the present invention 
to provide an improved system and method for routing 
real-time data traffic in an Internet Protocol communica- 
tions network. 

[0021] The above features are achieved as follows. A 
system is disclosed for routing of data traffic on a com- 
munications network. The system comprises of a plural- 
ity of gatekeepers interlinked to form a network wherein 
the plurality of gatekeepers control bandwidth and rout- 
ing of data packets towards destination terminals. The 
system further comprisesa plurality of routers which ag- 
gregate real time flow of data packets through said gate- 
keepers, and terminals which are connected to the net- 
work via the gatekeepers and which negotiate connec- 
tion parameters. Finally, a control means for directing 
real time flow of said data packets from one end-point 
terminal to another utilizing the gatekeepers and the 
routers is disclosed. 

[0022] In accordance with a preferred embodiment of 
the present invention, the system utilizes defined proto- 
cols which permit the shortest path between nodes on 
the network to be determined based on cost and effi- 
ciency. These shortest paths are saved within databas- 
es present in the system and are utilized to route the 
data. Second shortest paths are also determined to en- 
able for continued transfer of data in the event the short- 
est paths are unavailable. 

[0023] The above as well as additional objectives, 
features, and advantages of the present invention will 
become apparent in the following detailed written de- 
scription. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0024] The novel features believed characteristic of 
the invention are set forth in the appended claims. The 
invention itself, however, as well as a preferred mode of 
use, further objectives and advantages thereof, will best 
be understood by reference to the following detailed de- 
scription of an illustrative embodiment when read in con- 
junction with the accompanying drawings, wherein: 

Figure 1a depicts one representation of a physical 
network of a communications system according to 
the present invention; 

Figure 1 b depicts another representation of a phys- 
ical network of a communications system according 
to the present invention; 



Figure 2 is a diagram one embodiment of a com- 
munications system according to the present inven- 
tion illustrating the logical network connections of 
the routers; 

Figure 3 depicts a logical network of gatekeepers 
for the communications system of Figure 1; 

Figure 4 is a diagram of a communications system 
illustrating the router tables and IP addresses ac- 
cording to the present invention; 

Figure 5 is a diagram of a communications system 
illustrating the cost of data transfer within the sys- 
tem according to the present invention; 

Figure 6 depicts a link illustrating bandwidth allo- 
cation according to the present invention; and 

Figure 7 is a diagram of a communications system 
illustrating a broken logical link and the re-routing 
of data according to the present invention. 

DETAILED DESCRIPTION OF AN ILLUSTRATIVE 



[0025] With reference now to the figures, several re- 
lated diagrams of a communications system are depict- 
ed according to the present invention. In particular, the 

30 present invention may be implemented with the basic 
network as shown in Figure 1a and Figure 1b. Figure 
1a depicts a network with several gatekeepers 100, end- 
points 102, and terminals 104. Gatekeepers 100, end- 
points 102, and terminals 104 are interconnected via 

35 links 1 06. Note that gatekeepers 1 00 are linked together 
to form the framework of the network while endpoints 
102 and terminals 104 serve as the branches to this 
framework. Figure 1b depicts a slightly more complex 
embodiment of the network of Figure 1a. Figure 1 b also 

40 has gatekeepers 100, endpoints 102, and terminals 
104. However, in Figure 1b, endpoints 102 are connect- 
ed first to gateways 108 which represent a node of end- 
points 102. Gateways 108 are then connected to the 
framework of gatekeepers 100. 

45 [0026] The idea behind the invention is to allocate 
bandwidth through WFQ on strategic links for real-time 
traffic which is defined as a type of service on the IP 
network. The bandwidth is then controlled through the 
gatekeepers on the network to guarantee a quality of 

so service to each accepted real-time connection on the 
network. 

[0027] The gatekeepers and the logical links connect- 
ing them may be arranged in at least the following two 
possible configurations. These various features of Fig- 
55 ure 1 a and Figure 1 b are replicated in the other figures 
presented in this illustrative embodiment. Their respec- 
tive descriptions are similar throughout and are not giv- 
en further attention in the following figures of this enrv 
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thermore, a real-time IP packet can get stuck behind a 
long packet which can be as much as 1500 bytes. This 
will add significant delay to the real-time packet even if 
routing speed is increased. 

[0009] The Internet Engineering Task Force (IETF) 
has standardized an approach to reserve resources 
(bandwidth, and switching capacity) in routers. This 
standard is known as Resource Reservation Protocol 
(RSVP). In this approach, the packet scheduler in each 
router must look at the packet origination and destina- 
tion address and sometimes the IP port and then consult 
its RSVP tables to see if this packet has a reservation 
and then make a decision to forward it ahead of others. 
This places a significant additional load on the scheduler 
which makes serving a large number of RSVP flows tra- 
versing through a router very difficult or impossible. 
Most router manufacturers do not explicitly reserve re- 
sources in each router on the path as specified in the 
standard. Additionally, RSVP does not distinguish be- 
tween data flows and voice flows. The number of data 
flows may be two (2) orders of magnitude more than the 
number of voice flows. 

[0010] In the original IP standard, there was a field 
provided in the IP header to differentiate between types 
of packets. This is the type of service field. Five types 
of services are defined in the IP standard and another 
11 possible types are yet undefined. The service types 
are enforced at the packet scheduler in the router which 
can give preferential treatment to some types of service. 
In addition, the weight or the link cost utilized in OSPF 
for routing can yield a different value for each type of 
service. Various kinds of priority mechanisms have been 
proposed for type of service enforcement. One of them 
is called fair queuing which can divide the link bandwidth 
into multiple types of service such that any type of serv- 
ice cannot exceed its allocated bandwidth when the oth- 
er types of service are utilizing their bandwidth, but when 
the other types are not utilizing their bandwidth then one 
type of service can exceed its share of bandwidth. One 
of these mechanisms is called weighted fair queuing 
(WFQ) which can allocated any amount of bandwidth to 
each type of service instead of equal amount to all. 
[0011] Another set of standards called H.323 (or H. 
323v2) have been proposed to do call control (i.e. make 
connections) of real-time service on IP networks. This 
feature allows end-points or terminals wanting to make 
connections to negotiate bandwidth and coding require- 
ments before the connection is established. In this 
standard there are three key players, endpoints, gate- 
keepers, and gateways. End-points are terminals which 
need to make connections. They request the connection 
through a gatekeeper (if one is on the network) and they 
also negotiate the connection parameters. Gatekeepers 
are entities that do bandwidth control (on LANs) and 
routing of connection packets towards the destination 
terminal. A gateway is an entity which can be thought of 
as a collection of end-points, but these entities also 
translate from other bearer protocols (such as TDM) to 



the IP protocol. Note that although each display distinct 
functions for the purpose of the claims, all three may be 
referred to generically as a node. 
[0012] The Open Shortest Path First (OSPF) protocol 
s is a TCP/IP Internet routing protocol. OSPF is classified 
as an Interior Gateway Protocol (IGP), i.e. it distributes 
routing information between routers belonging to a sin- 
gle autonomous system. It is intended to be utilized with- 
in an IP network under common administration. OSPF 

10 also provides for the authentication of routing updates, 
and utilizes IP multicast when sending/receiving the up- 
dates. OSPF routes packets based solely on the desti- 
nation IP address found in the IP packet header. IP 
packets are routed "as is" they are not encapsulated 

*5 in any further protocol headers as they transit the Au- 
tonomous System (AS). OSPF is a dynamic routing pro- 
tocol. II quickly detects topological changes in the AS 
(such as router interface failures) and calculates new 
loop-free routes after a period of convergence. 

20 [0013] OSPF enables the routers to exchange infor- 
mation about their interfaces (whether they are up or 
down, how fast they go, and to whom they connect) and 
maintain a complete, synchronized, link state database 
in every router. It provides rapid, deterministic calcula- 

2S tion of Internet routes and optimized route calculations. 
[0014] Routing protocols define the rules that routers 
utilize to communicate with each other. Routing proto- 
cols dynamically provide the network topology informa- 
tion necessary to choose paths amongst routers, allow- 

30 ing routers to automatically choose routes and to alter 
them when network changes occur. Beyond these ba- 
sics, routing protocols vary greatly in design, capability, 
implementation, and impact on network infrastructure. 
[0015] By far the most widely implemented routing 

35 protocol is the Routing Information Protocol (RIP). RIP 
was the first common TCP/IP routing protocol and is 
supported by most routers. RIP became a component 
of TCP/IP when it was included with Berkeley Standard 
Distribution (BSD) UNIX in 1982. Even though RIP has 

40 many limitations, RIP's simplicity and interopability have 
spurred its implementation in TCP/IP networks world- 
wide. 

[0016] In today's complex internetworking environ- 
ments, especially on the Internet, RIP's limitations have 
45 become most apparent. RIP does not scale well to larger 
networks, consuming large amounts of network band- 
width. Also, RIP lacks several key features that can 
make today's networks much more responsive and flex- 
ible. 

50 [0017] Therefore, it would desirable to have an im- 
proved IP communications system that reduces the 
amount of hardware required, reduces the end-to-end 
delay, tolerates faults, and employs inexpensive tech- 
nology. Additionally, it would be further advantageous to 

55 have an improved IP communications system that con- 
sumes less power and is scalable to handle varying 
amounts of total traffic. 
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bodiment. 

[0028] Users/Customers access the network via ter- 
minals 104 which are connected to the network end- 
points 102. In Figure 1b, several customers may con- 
nect to gateways 108. Each entrance to the network 
could be a Point of Presence (POP) which takes data 
traffic from several customers or gateways 108. Gate- 
keepers 100 are mapped onto their physical location 
and links 106 are then mapped onto the physical net- 
work as the shortest path between these physical loca- 
tions according to the link costs of the type of service 
for real-lime traffic. The dimensioning of the logical links 
between gatekeepers 100 is done by looking at the traf- 
fic going through those links (this traffic will be multi-rate 
for different kinds of multi-media traffic) and allocating 
bandwidth utilizing a typical multi-rate blocking formula. 
[0029] The network of Figure 2 is an example of both 
the physical network of routers 202 and the network of 
gatekeepers 1 00 and their links 1 06. In Figure 2, routers 
202 are interconnected via links 106 which have band- 
width 204. Bandwidth 204 of link 106 is a function of the 
network link components and may vary within links. In 
the illustrated embodiment, links 106 with specific band- 
widths 204 run between gatekeepers 100 and routers 
202. As depicted, a portion of link 1 06 is allocated to real 
time bandwidth 204b. Routers 202 populate the entire 
network at every level. 

[0030] Each router maintains a database describing 
the AS's topology (the router's link state). Each individ- 
ual piece of this database is a particular router's local 
state (e.g., the router's usable interfaces and reachable 
neighbors). The router distributes its local state through- 
out the AS. Each router constructs a tree of shortest 
paths with itself as root. This shortest path gives the 
route to each destination in the AS. Externally derived 
routing information appears on the tree as leaves. The 
tree gives the entire path to any destination network or 
host. However, only the next hop to the destination is 
utilized in the forwarding process. After the tree is cre- 
ated the external routing information is examined and 
disseminated throughout the network. The best route to 
any router has also been calculated. When several 
equal-cost routes to a destination exists, traffic is dis- 
tributed equally among thern. If a router's link state 
changes, only the changed information is propagated 
through the Internet, then every other router simultane- 
ously calculates the optimal routes. Detected failures in 
the Internet are quickly messaged and the result is de- 
terministic. Also, taking advantage of a new Internet 
path takes very little overhead time. OSPF permits for 
a significant reduction in routing traffic. A cost is asso- 
ciated with the output side of each router interface (link). 
This cost is typically inversely proportional to the link 
bandwidth, but can be set to any value by the network 
administrator. The lower the cost, the more likely the in- 
terface is utilized to forward data traffic. 
[0031] When a router starts, it first initializes the rout- 
ing protocol data structures. The router then waits for 



indications from the lower level protocols that its inter- 
faces are functional. A router then utilizes the OSPF's 
Hello Protocol to reach neighbors. The router sends Hel- 
lo packets to its neighbors, and in turn receives their Hel- 

s lo packets. On broadcast and point to point networks, 
the router dynamically detects its neighboring routers by 
sending its Hello packets to the multicast address All- 
SPFRouters. On non-broadcast networks, some config- 
uration information may be necessary in order to discov- 

10 er neighbors. On broadcast and NBMA networks the 
Hello Protocol also elects a designated router for the 
network. 

[0032] The router will attempt to form adjacencies with 
some of its newly acquired neighbors. Link state data- 
* s bases are synch ronized between pairs of adjacent rout- 
ers. On broadcast and NBMA networks, the Designated 
Router determines which routers should become adja- 
cent. Adjacencies control the distribution of routing in- 
formation. Routing updates are sent and received only 
20 on adjacencies. 

[0033] A router periodically advertises its state, which 
is also called link state. Link state is also advertised 
when a router's state changes. A router's adjacencies 
are reflected in the contents of its LSAs. This relation- 
's ship between adjacencies and link state allows the pro- 
tocol to detect dead routers in a timely fashion. 
[0034] LSAs are flooded throughout the area. The 
flooding algorithm is reliable, ensuring that all routers in 
an area have exactly the same link state database. This 
30 database consists of the collection of LSAs originated 
by each router belonging to the area. From this data- 
base each router calculates a shortest path tree with it- 
self as root. This shortest path tree in turn yields a rout- 
ing table for the protocol. 
35 [0035] The routing of the H.225 messages of H.323 
protocol will require that gatekeepers specify the next 
gatekeepers for the message. In the preferred embodi- 
ment, it is proposed that this routing be done using 
OSPF (or OSPFv2). The OSPF routing protocol over- 
do comes many of the limitations of RIP. Although the cur- 
rent version of OSPF was first formalized in 1 99 1 , OSPF 
has become more widely deployed only recently. Larger 
ISPs and corporations alike are beginning to require the 
broad feature set offered by OSPR In contrast to RIP, 
45 OSPF scales to larger networks and is much faster to 
converge. The most fundamental difference between 
OSPF and RIP is that they are based on two different 
algorithms. OSPF is based on the Dijkstra link state al- 
gorithm. RIP is based on the Bellman-Ford distance 
so vector algorithm. Utilizing OSPF's link state algorithm, 
every router maintains a similar network map identifying 
all links between neighbors. Best paths are calculated 
from these maps. OSPF also ensures that updates sent 
to neighboring routers are acknowledged by neighbors, 
5S verifying that all routers have consistent network maps. 
Utilizing RIP's distance vector algorithm, every router 
creates a unique routing table identifying the best path 
from itself to all other routers in the network. 
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[0036] Of the two protocols, OSPF's acknowledge- 
ment-oriented routing update process is far more re- 
sponsive to network topology changes. Routers can 
make decisions faster when their network information is 
known to be consistent with that of other routers. Figure 
3 illustrates OSPF running at the logical network of gate- 
keepers 100 and will be different from the OSPF running 
at the router level. Each gatekeeper 1 00 will have a rout- 
ing table. 

[0037) Figure 4 shows an example of such a routing 
table 404 for an example message. In the first column 
of routing table 404 is the destination end-point or gate- 
way's IP address 402. The second column of routing ta- 
ble 404 will specify the IP address 402 of the next gate- 
keeper (or the destination endpoint 403b or gateway 
403a if that is appropriate). The way that these routing 
tables are constructed is exactly like OSPF. The opera- 
tion of routing table 404 may be explained as follows. 
[0038] Each node learns of its cost to its neighbors 
and the IP address directly reachable from them. Each 
node then broadcasts this information to its neighbors. 
Each neighbor, once it has received this information, 
then re-broadcasts this information to its neighbors ex- 
cept that they do not send it back to the node where the 
information came from and they observe the packet time 
to live and if that has expired they do not forward the 
packet. Also, the packet time to live is decremented. 
This way all the nodes learn of all the nodes neighbors 
and thus build the total network topology. Then they uti- 
lize the shortest path algorithms to find routes from 
themselves to all the other nodes. Then they can utilize 
the routing information from these algorithms to find the 
next node for each possible destination. 
[0039] Figure 5 shows the cost analysis for the trans- 
fer of data within the network according to one embod- 
iment of the invention. Each node calculates its cost to 
its neighbors 502 and stores these costs within a data- 
base. The nodes will send information to each other to 
build routing tables. Each gatekeeper 100 will have in- 
formation about all the logical links connecting it to other 
gatekeepers 100 in its internal database. This informa- 
tion will likely be input through a craftsperson or it could 
be updated automatically by the router connecting to 
gatekeeper 100. Once gatekeeper 100 receives a SET- 
UP message (H.225) to a destination IP address, it first 
looks up the next node (gatekeeper) from the routing 
table and then link 106 to the next node. It then looks at 
all the existing connections through that logical link. If 
the effective bandwidth (CAC) of the new setup mes- 
sage is less than the remaining effective bandwidth, it 
allows the connection through and sends the SETUP 
message to the next gatekeeper. 

[0040] Figure 6 depicts an example logical link 502 
connecting gatekeepers 100 via routers 202 and which 
have 198Mb/s of effective bandwidth of connections 
running between them. Note that logical link 602 is di- 
vided into sub-potions dedicated to different types of da- 
ta traffic 602a. If a SETUP message is received which 



requests an additional 1.5Mb/s of effective bandwidth 
for a new connection, this connection is then accepted 
•because the total effective bandwidth is still under the 
200Mb/s of bandwidth for the logical link. 

s [0041] Figure 7 depicts what happens if a logical link 
between gatekeepers 1 00 gets disconnected due to fib- 
er cuts 702 or due to other reasons. The bearer packet 
would then take second shortest path 704 according to 
OSPF for the type of service for real-time services. If 

io prior real-time bandwidth is allocated on this path using 
WFQ, then the performance of the connection on that 
logical link is not affected. 

[0042] In this embodiment; logical links between two 
gatekeepers lie on the shortest path between the gate- 
*s keepers according to the weights on the links for the re- 
al-time type of service, and spare capacity for each of 
the above logical links (if allocated) lie on the second 
shortest path between the respective gatekeepers. 
[0043] The description of the preferred embodiment 
of the present invention has been presented for purpos- 
es of illustration and description, but is not intended to 
be exhaustive or limit the invention in the form disclosed. 
For example, although IP data packets are routed in the 
depicted examples, other types of data packets also 
may be routed according to the present invention. Many 
modifications and variations will be apparent to those of 
ordinary skill in the art. The embodiment was chosen 
and described in order to best explain the principles of 
the invention and the practical application to enable oth- 
ers of ordinary skill in the art to understand the invention 
for various embodiments with various modifications as 
are suited to the particular use contemplated. 



Claims 

1. A system for routing of real time data traffic on a 
communications network comprising: 

a plurality of gatekeepers linked together to 
form a network wherein said plurality of gate- 
keepers control bandwidth and routing of data 
packets towards destination terminals; 

a plurality of routers which aggregate real time 
flow of data packets through said gatekeepers; 

terminals which are connected to the network 
via said gatekeepers and which negotiate con- 
nection parameters; and 

control means for directing real time flow of said 
data packets from one end point terminal to an- 
other utilizing said gatekeepers and said rout- 
ers. 

2. The system of Claim 1 , further comprising a plurality 
of gateways wherein said gateways represent a col- 
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lection of said terminals and said gateways trans- 
late other bearer protocols to the Internet Protocol. 

3. The system of Claim 1, wherein said network 
formed by said gatekeepers and routers reduces s 
variance and synchronizes packet transmission in 
the routing of data traffic and further comprising 
means for: 

enabling inelastic/real time traffic utilizing a Re- 10 
al-time Transport Protocol (RTP); and 

allocating bandwidth to types of service includ- 
ed in the data packets utilizing weighted fair 
queuing (WFQ). is 

4. The system of Claim 1, wherein said plurality of 
gatekeepers utilize standards of data transfer which 
permit call-control of real time service on communi- 
cation networks and allow terminals to negotiate 20 
bandwidth and coding requirements prior to estab- 
lishing connection with said network of gatekeepers 
and routers. 

5. The system of Claim 1 , wherein said routers and 2s 
gatekeepers utilize a process of determining the 
shortest path between said routers and gatekeep- 
ers and further wherein the shortest paths are uti- 
lized in establishing the communications network at 

the logical level of said gatekeepers and at a differ- 30 
ent network level for said routers. 

6. The system of Claim 1 , wherein said routers include 
software switching algorithms programmed with a 
predetermined percent representing a portion of the 35 
data traffic reserved for real time traffic and further 
wherein said routers give a higher priority to said 
predetermined percent of the data traffic reserved 

for real time traffic in routing data to its destination. 

40 

7. The system of Claim 1 t wherein said gatekeepers 
log routing information in a routing table comprising 
a first column indicating an address node and a sec- 
ond column specifying another address node, and 
wherein said routing table is constructed utilizing 45 
the shortest paths of logical links and further where- 
in said routing table and other routing information 
are stored in an internal database of said gatekeep- 
er. 

so 

8. The system of Claim 7, wherein modification of said 
stored routing table and other routing information is 
conducted by software algorithms of the routers. 

9. The system of Claim 1 , wherein each gatekeeper 55 
utilizes shortest path algorithms to interconnect with 
neighboring gatekeepers based on logical links de- 
termined from both cost of said gatekeeper to its 



neighbors and IP addresses directly reachable from 
said gatekeeper, and further wherein said logical 
links are utilized to build a network topology to find 
routes to other gatekeepers. 

10. The system of Claim 9, wherein a second shortest 
path with spare capacity is identified and wherein 
disconnection of said logical link between gate- 
keepers results in the data packets being directed 
to said second shortest path. 

11. A method of routing of real time data traffic on a 
communications network comprising the steps of: 

linking together a plurality of gatekeepers to 
form a network wherein said plurality of gate- 
keepers control bandwidth and routing of data 
packets towards destination terminals; 

aggregating real time flow of data packets 
through said gatekeepers utilizing a plurality of 
routers; 

negotiating connection parameters utilizing ter- 
minals which are connected to the network via 
said gatekeepers; and 

controlling real time flow of said data packets 
from one end point terminal to another utilizing 
said gatekeepers and said routers. 

12. The method of Claim 11, wherein said controlling 
step includes the step of translating other bearer 
protocols to the Internet Protocol utilizing a plurality 
of gateways representing a collection of said termi- 
nals. 

13. The method of Claim 11, wherein said controlling 
step includes the step of network formed by said 
gatekeepers and routers is utilized to reduce vari- 
ance and synchronizes packet transmission in the 
routing of data traffic and further comprising the 
steps of: 

enabling inelastic/real time traffic utilizing a Re- 
al-time Transport Protocol (RTP); and 

allocating bandwidth to types of service includ- 
ed in the data packets utilizing weighted fair 
queuing (WFQ). 

14. The method of Claim 11, wherein said plurality of 
gatekeepers utilize standards of data transfer which 
permit call-control of real time service on communi- 
cation networks, and further comprising the step of 
allowing terminals to negotiate bandwidth and cod- 
ing requirements prior to establishing connection 
with said network of gatekeepers and routers. 
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15. The method of Claim 11 , wherein said routers and 
gatekeepers utilize a process of determining the 
shortest path between said routers and gatekeep- 
ers, and further comprising the step of establishing 
the communications network at the logical level of 
said gatekeepers and at a different level network for 
said routers utilizing the shortest paths. 

16. The method of Claim 11, wherein said routers in- 
clude software switching algorithms programmed 
with a predetermined percent representing a por- 
tion of the data traffic reserved for real time traffic 
and further comprising the step of assigning a high- 
er priority to said predetermined percent of the data 
traffic reserved for real time traffic in routing data to 
its destination. 

17. The method of Claim 11 , wherein said gatekeepers 
log routing information in a routing table comprising 
a first column indicating an address node and a sec- 
ond column specifying another address node, and 
wherein said routing table is constructed utilizing 
the shortest paths of logical links and further where- 
in said routing table and other routing information 
are stored in an internal database of said gatekeep- 
er. 

18. The method of Claim 17, further comprising the step 
of modifying said stored routing table and other 
routing information utilizing software algorithms of 
the routers. 

1 9. The method of Claim 1 1 , wherein each gatekeeper 
utilizes shortest path algorithms to interconnect with 
neighboring gatekeepers based on logical links de- 
termined from both cost of said gatekeeper to its 
neighbors and IP addresses directly reachable from 
said gatekeeper, and further wherein said logical 
links are utilized to build a network topology to find 
routes to other gatekeepers. 

20. The method of Claim 1 9, wherein a second shortest 
path with spare capacity is identified and wherein 
disconnection of said logical link between gate- 
keepers results in the data packets being directed 
to said second shortest path. 

21. A computer program product comprising: 

a storage medium; and 

program instruction on said storage medium for 
routing of real time data traffic on a communi- 
cations network including: (1)a plurality of gate- 
keepers linked together to form a network 
wherein said plurality of gatekeepers control 
bandwidth and routing of data packets towards 
destination terminals; (2)a plurality of routers 



which aggregate real time flow of data packets 
through said gatekeepers; (3)terminals which 
are connected to the network via said gate- 
keepers and which negotiate connection pa- 
5 rameters; and (4)control means for directing re- 

al time flow of said data packets from one end 
point terminal to another utilizing said gate- 
keepers and said routers. 

to 22. The computer program product of Claim 21 , where- 
in said programming instructions further provides a 
plurality of gateways representing a collection of 
said terminals and said gateways translate other 
bearer protocols to the Internet Protocol. 

75 

23. The computer program product of Claim 21 , where- 
in said programming instructions further provides 
that said network formed by said gatekeepers and 
routers reduces variance and synchronizes packet 
20 transmission in the routing of data traffic and further 
comprising: 

enabling inelastic/real time traffic utilizing a Re- 
al-time Transport Protocol (RTP); and 

25 

allocating bandwidth to types of service includ- 
ed in the data packets utilizing weighted fair 
queuing (WFQ). 

30 24. The computer program product of Claim 21 , where- 
in said programming instructions further provides 
said plurality of gatekeepers utilize standards of da- 
ta transfer which permit call-control of real time 
service on communication networks and allow ter- 

35 minals to negotiate bandwidth and coding require- 
ments prior to establishing connection with said net- 
work of gatekeepers and routers. 

25. The computer program product of Claim 21 , where- 
to in said programming instructions further provides 

said routers and gatekeepers utilize a process of 
determining the shortest path between said routers 
and gatekeepers and further wherein the shortest 
paths are utilized in establishing the communica- 
4$ tions network at the logical level of said gatekeepers 
and at a different network level for said routers. 

26. The computer program product of Claim 21 , where- 
in said programming instructions further provides 

50 said routers include software switching algorithms 
programmed with a predetermined percent repre- 
senting a portion of the data traffic reserved for real 
time traffic and further wherein said routers give a 
higher priority to said predetermined percent of the 
55 data traffic reserved for real time traffic in routing 
data to its destination. 

27. The computer program product of Claim 21 , where- 



to 



25 
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in said programming instructions further provides 
said gatekeepers log routing information in a routing 
table comprising a first column indicating an ad- 
dress node and a second column specifying anoth- 
er address node, and wherein said routing table is 
constructed utilizing the shortest paths of logical 
links and further wherein said routing table and oth- 
er routing information are stored in an internal da- 
tabase of said gatekeeper. 



w 



28. The computer program product of Claim 27, where- 
in said programming instructions further provides 
modification of said stored routing table and* other 
routing information is conducted by software algo- 
rithms of the routers. '5 

29. The computer program product of Claim 21 , where- 
in said programming instructions further provides 
each gatekeeper utilizes shortest path algorithms 

to interconnect with neighboring gatekeepers 20 
based on logical links determined from both cost of 
said gatekeeper to its neighbors and IP addresses 
directly reachable from said gatekeeper, and further 
wherein said logical links are utilized to build a net- 
work topology to find routes to other gatekeepers. 2s 

30. The computer program product of Claim 29, where- 
in said programming instructions further provides a 
second shortest path with spare capacity is identi- 
fied and wherein disconnection of said logical link 30 
between gatekeepers results in the data packets 
being directed to said second shortest path. 
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thermore, a real-lime IP packet can get stuck behind a 
long packet which can be as much as 1500 bytes. This 
will add significant delay to the real-time packet even if 
routing speed is increased. 

[0009] The Internet Engineering Task Force (IETF) s 
has standardized an approach to reserve resources 
(bandwidth, and switching capacity) in routers. This 
standard is known as Resource Reservation Protocol 
(RSVP). In this approach, the packet scheduler in each 
router must look at the packet origination and destina- io 
tion address and sometimes the IP port and then consult 
its RSVP tables to see if this packet has a reservation 
and then make a decision to forward it ahead of others. 
This places a significant additional load on the scheduler 
which makes serving a large number of RSVP flows tra- is 
versing through a router very difficult or impossible. 
Most router manufacturers do not explicitly reserve re- 
sources in each router on the path as specified in the 
standard. Additionally, RSVP does not distinguish be- 
tween data flows and voice flows. The number of data 20 
flows may be two (2) orders of magnitude more than the 
number of voice flows. 

[0010] In the original IP standard, there was a field 
provided in the IP header to differentiate between types 
of packets. This is the type of service field. Five types 2s 
of services are defined in the IP standard and another 
1 1 possible types are yet undefined. The service types 
are enforced at the packet scheduler in the router which 
can give preferential treatment to some types of service. 
In addition, the weight or the link cost utilized in OSPF 30 
for routing can yield a different value for each type of 
service. Various kinds of priority mechanisms have been 
proposed for type of service enforcement. One of them 
is called fair queuing which can divide the link bandwidth 
into multiple types of service such that any type of serv- 35 
ice cannot exceed its allocated bandwidth when the oth- 
er types of service are utilizing their bandwidth, but when 
the other types are not utilizing their bandwidth then one 
type of service can exceed its share of bandwidth. One 
of these mechanisms is called weighted fair queuing 40 
(WFQ) which can allocated any amount of bandwidth to 
each type of service instead of equal amount to all. 
[0011] Another set of standards called H.323 (or H. 
323v2) have been proposed to do call control (i.e. make 
connections) of real-time service on IP networks. This 45 
feature allows end-points or terminals wanting to make 
connections to negotiate bandwidth and coding require- 
ments before the connection is established. In this 
standard there are three key players, endpoints, gate- 
keepers, and gateways. End-points are terminals which so 
need to make connections. They request the connection 
through a gatekeeper (if one is on the network) and they 
also negotiate the connection parameters. Gatekeepers 
are entities that do bandwidth control (on LANs) and 
routing of connection packets towards the destination ss 
terminal. A gateway is an entity which can be thought of 
as a collection of end-points, but these entities also 
translate from other bearer protocols (such as TDM) to 



the IP protocol. Note that although each display distinct 
functions for the purpose of the claims, all three may be 
referred to generically as a node. 
[0012] The Open Shortest Path First (OSPF) protocol 
is a TCP/IP Internet routing protocol. OSPF is classified 
as an Interior Gateway Protocol (IGP), i.e. it distributes 
routing information between routers belonging to a sin- 
gle autonomous system. It is intended to be utilized with- 
in an IP network under common administration. OSPF 
also provides for the authentication of routing updates, 
and utilizes IP multicast when sending/receiving the up- 
dates. OSPF routes packets based solely on the desti- 
nation IP address found in the IP packet header. IP 
packets are routed "as is" - they are not encapsulated 
in any further protocol headers as they transit the Au- 
tonomous System (AS). OSPF is a dynamic routing pro- 
tocol. It quickly detects topological changes in the AS 
(such as router interface failures) and calculates new 
loop-free routes after a period of convergence. 
[0013] OSPF enables the routers to exchange infor- 
mation about their interfaces (whether they are up or 
down, how fast they go, and to whom they connect) and 
maintain a complete, synchronized, link state database 
in every router. It provides rapid, deterministic calcula- 
tion of Internet routes and optimized route calculations. 
[0014] Routing protocols define the rules that routers 
utilize to communicate with each other. Routing proto- 
cols dynamically provide the network topology informa- 
tion necessary to choose paths amongst routers, allow- 
ing routers to automatically choose routes and to alter 
them when network changes occur. Beyond these ba- 
sics, routing protocols vary greatly in design, capability, 
implementation, and impact on network infrastructure. 
[0015] By far the most widely implemented routing 
protocol is the Routing Information Protocol (RIP). RIP 
was the first common TCP/IP routing protocol and is 
supported by most routers. RIP became a component 
of TCP/IP when it was included with Berkeley Standard 
Distribution (BSD) UNIX in 1982. Even though RIP has 
many limitations, RIP's simplicity and interopability have 
spurred its implementation in TCP/IP networks world- 
wide. 

[0016] In today's complex internetworking environ- 
ments, especially on the Internet, RIP's limitations have 
become most apparent. RIP does not scale well to larger 
networks, consuming large amounts of network band- 
width. Also, RIP lacks several key features that can 
make today's networks much more responsive and flex- 
ible. 

[0017] Therefore, it would desirable to have an im- 
proved IP communications system that reduces the 
amount of hardware required, reduces the end-to-end 
delay, tolerates faults, and employs inexpensive tech- 
nology. Additionally, it would be further advantageous to 
have an improved IP communications system that con- 
sumes less power and is scalable to handle varying 
amounts of total traffic. 
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(54) Mechanism to guarantee quality of service to real-time traffic on IP networks 



(57) A system for routing of data traffic on a commu- 
nications network comprising a plurality of gatekeepers 
interlinked to form a network wherein the plurality of 
gatekeepers control bandwidth and routing of data 
packets towards destination terminals. A plurality of 



routers aggregate real timef low of data packets through 
said gatekeepers, and terminals which are connected 
to the network via the gatekeepers, negotiate connec- 
tion parameters. Real time flow of said data packets is 
directed from one end point terminal to another utilizing 
the gatekeepers and the routers. 
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